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FIELD OF THE INVENTION 



15 [0002] This invention relates to methods for estabUshing parameters for 
modelling the behaviour of crop harvesting machines such as but not limited to 
combine harvesters. In particular it relates to a method for optimizing stochastic 
model parameters in models for a crop processing operation in such harvesting 
machines. The method is particularly useful in the context of "precision farming" 

20 techniques, in which combine harvesters and other harvesting machines have 
played a significant role, as well for the development as for the application of 
these techniques. 



25 



BACKGROUND OF THE INVENTION 



[0003] "Precision farming" is a broad term that embraces practices such as: 



- field yield mapping aimed at accurately mapping the crop-producing 
productivity of a field so that: 
30 • seeds and agro-chemicals can be economically and correctly applied 
without over- and under-dosing the plants; 
• harvesting and other agricultural machinery can be adjusted to take 
account of varying crop conditions from place to place in a field; 
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- modelling, of process conditions, within agricultural machines, and developing 
control philosophies aimed at: 

• improving machine efificiency or workrate; 
5 • reducing fuel consumption; and 

• improving the quality of work carried out by agricultural machines; and 

- providing alerts and reports of abnormal conditions in crops. 

10 [0004] Sometimes the overall improvement in farming efficiency resulting 
from an individual precision farming practice might be only a few percent; but 
cumulatively such efforts have dramatically improved productivity in mechanised 
farming over recent years. 

15 [0005] The significance of harvesters, such as combine harvesters, to precision 
farming derives principally from the following factors: 

(i) A harvester is able to assess the output of a farming operation for example in 
terms of crop yield. A field map of such data is invaluable in improving 

20 farming efficiency in future crop growing and harvesting seasons; and 

(ii) Harvesters are complicated machines that provide numerous sites for the 
location of transducers whose function is to gather data on the harvesting 
processes and the crops passing through the machine. 

25 

[0006] As noted, the combine harvester has been particularly useful in 
producing maps indicating the expected crop yield at different locations in a field. 
Farmers can use such maps (tiiat are readily stored in digital form in a computer 
memory) to control in an accurate way the processes forming part of a crop 
30 growing season, so that the yield of the field is maximized. 



[0007] Prior art techniques for yield mapping, however, are limited primarily 
because they concentrate on the quantity of the useable part of the crop that is 
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conveyed to e.g. the clean grain tank in a combine harvester. 

[0008] Although measurements of e.g. the mass flowrate of clean grain to the 
clean grain tank may readily be compensated for some variables such as grain 
5 moisture content and grain type, some difficulties remain. 

[0009] Significant among these is the fact that mass flowrate measurements of 
crop yield generally take no account of crop losses arising from e.g. incomplete or 
faulty threshing of ears in the threshing drum or another part of the harvester 
10 where grain separation occurs. Where the machine load exceeds the threshing, 
separation and/or cleaning capacity of the machine a portion of the harvested grain 
will not be separated from the straw and chaff and be deposited therewith on the 
field behind the machine. 

15 [0010] It is known, for example, that the extent to which (or the ease with 
which) ears are threshed in the threshing drum of a combine harvester is strongly 
dependent on the feedrate of crop into the harvesting machine, when such factors 
as grain and straw moisture, crop variety and straw length are kept as constants. 
Thus for higher feedrates relatively less grain is separated in the first concave 

20 threshing drum section than in the case of low feedrates. More grain has to be 
separated in the further stages of the harvester. 

[GO 11] Consequently for such high feedrates a lesser proportion of the crop is 
therefore likely to reach the clean grain tank, with the result that a yield 
25 measurement taken at such a location may be inaccurate. Furthermore such a 
measurement takes no account of the extent to which grains become damaged or 
lost within the combine harvester. 

[0012] In reality a great number of variables influences the extent to which the 
30 threshing and separating sections are able to separate grain from other plant matter 
such as chaff and straw. Such variables include, but are not limited to: 

- the nature of the soil in which the crop grows; 

- settings of various adjustable components of the harvesting machine, e.g. the 
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height of the header bar in a combine harvester, which directly influences the 
straw to grain ratio; 

- the slope of the field in which the machine operates; 

- the moisture content of the crop; 
5 - the crop type; 

- the forward speed of the harvesting machine; 

- the presence of weed patches; 

- the state (wear) of the machine elements; 

- the type of installed machine elements, e.g. the type of rasp bars; 
10 and so on. 

[0013] According to a first aspect of the invention there is provided a method 
of substantially continuously optimizing a stochastic parameter S that 
characterizes the instantaneously prevailing readiness with which crop is 
15 processed in a harvesting machine, including the step of recursively calculating 
the optimized parameter value in accordance with the following algorithm: 

m=f{kt-iMj(t-m - (A) 

wherein: 

3(t) is the optimized stochastic parameter value at time t; and 
20 s{t, 3{t)) is an error prediction function. 

[0014] Such a method is highly suited to the continuous optimization of the 
highly stochastic parameter i9 that, when applied to the threshing and separation 
process a combine harvester, may fairly be termed a "threshability" parameter, i.e. 
25 an indication of the extent to which the harvesting machine is capable of threshing 
the crop at time L 

[0015] Such a parameter is useable in various ways, as discussed hereinbelow. 

30 [0016] The algorithm generally may take the form of: 
i^(0 = /(^(r-l),...,5(/-n,),^(/),...,^(r^A2j,0 
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[0017] The method of the broad aspect of the invention can readily be carried 
out using a suitably programmed computer carried by or forming part of the 
harvesting machine. 

5 [001 8] Preferably the algorithm (A) has the form: 

3{t) = 3{t - 1) + r{ty-' (Mu ^{t - 3it - 1)) 

wherein 

y{t) is a gain term; 

r(t) is a scalar approximation of a Hessian V"{S) in which Kis indicative 
10 which F is a quadratic error criterion; 

i//{t, S) = ^ in which i9) is an estimation of a value indicative of 

the effectiveness of said crop processing in said harvesting machine said 
estimation being based on stochastic parameter »9 ; and 

£{t,3(t-\)) is the difference between the actual effectiveness value y(t) 

15 and the estimated value y{t,3) based on the previously optimized parameter 

^(^-1). 

[0019] Preferably the algorithm (A) includes an estimation of r{t) that is 

weighted to reduce the influence, on the optimized parameter values 3 , of past 
20 measurements. 

[0020] This aspect of the method renders the parameter optimization more 
realistic and robust for a wide range of working conditions. 

25 [0021] The parameter «9 may be usable in a model for the relation between a 
value u(t) indicative of the feedrate of crop into the harvesting machine and a 
value y(t) indicative of the effectiveness of an operation processing said crop in 
said harvesting machine. The estimated value y{t, S) is then an estimation of the 
effectiveness obtained by the application of said model to the feedrate values u(t), 

30 

[0022] In this manner the model can be updated continuously in order to meet 
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any changes to the process caused by a wide range of changing conditions, e.g. 
varying crop properties such as ripeness or moisture or changes in inclination of 
the machine. 

5 [0023] Advantageously, the model may comprise an exponential function. 
Such form provides some computational advantages for the optimization of 3 . 

[0024] The effectiveness may take the form of a value indicative of crop flow, 
e.g. crop losses at the end of the separation or the cleaning section. It may also 
10 comprise the crop flow in a return system. 

[0025] According to a second aspect of the invention there is provided a 
method of operating a harvesting machine comprising the steps of: 

substantially continuously optimizing a stochastic parameter that 

15 characterizes the instantaneously prevailing readiness with which the harvesting 
machine processes crop; and 

substantially continuously adjusting a performance variable of the 
harvesting machine in dependence on the instantaneous, optimized value of said 
parameter in order to optimize the load of the harvesting machine so as to keep a 

20 value indicative of the effectiveness of said harvesting machine below a 
predetermined value. 

[0026] Such effectiveness value may comprise the losses of useable crop parts 
such as separation or cleaning sieve losses, or a proportion of damaged useable 
25 crop parts, e.g. broken grain kernels, or a proportion of unwanted material in the 
useable crop parts, e.g. chaff and straw and particles in the clean grain. 

[0027] Optimizing the machine load may comprise optimizing the feedrate of 
crop into the harvesting machine, e.g. by adapting the travel speed of the 
30 harvesting machine. 



[0028] Conveniently the step of adjusting a performance variable of the 
harvesting machine occurs in dependence on the output of an inverted form of an 

6 



effectiveness estimation function: 



j;(^,il) = exp(A.(/))-L - (B) 

5 Herein u(t) may be the measured feedrate and S) the grain losses. 

[0029] According to a third aspect of the invention there is provided a method 
of mapping one or more field lots for variations in a stochastic parameter that 
characterizes the instantaneously prevailing readiness with which a harvesting 
10 machine processes crop, the method comprising the steps of: 

operating a harvesting machine to harvest crop in a said field lot; 

simultaneously measuring the machine load and the machine effectiveness 
and determining the position of the machine in the field lot; 

storing data indicative of the position of the harvesting machine at time t; 
15 using the measured machine load and machine effectiveness data in an 

optimization of said parameter; and 

mapping the optimized parameter values obtained from the using the 
measured machine load and machine effectiveness data step so as to produce a 
parameter map of the field lot. 

20 

[0030] According to a fourth aspect of the invention there is provided a 
method of operating a harvesting machine comprising the steps of: 

substantially continuously optimizing a stochastic parameter that 
characterizes the instantaneously prevailing readiness with which the harvesting 
25 machine separates useable crop parts from other plant matter; and 

sending a display signal, that is indicative of the instantaneous parameter 
value, to a display device. 

[003 1] Preferably the display signal indicates an abnormal parameter value. 

30 

[0032] Preferably in each of the second, third and fourth aspects of the 
invention the optimization step is in accordance with the first aspect of the 
invention. Thus the method of the first aspect of the invention is highly versatile 
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in its application. 



[0033] Conveniently in each of the 2"^ to 4^^ aspects of the invention, when 
the parameter optimization is according to the first aspect of the invention, said 
5 selected part of the harvesting machine is selected from: 

the separation section, e.g. the straw walkers or a rotary separator; 

the sieve; 

the return flow system; 
the cleaning section; or 
10 the grain elevator; 

of a combine harvester. 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 [0034] The invention will now be described in more detail, by way of non- 
limiting example. In the following description reference is made to the 
accompanying drawing figures in which: 

[0035] Figure 1 is a schematic representation of the threshing, cleaning and 
20 straw walker sections of a combine harvester showing the possible locations for 
grain loss transducing devices; 

[0036] Figure 2 is a graphical representation of the highly stochastic nature of 
a processability, in particular threshability parameter i9, by reference to field 
25 slope (gradient) values; 

[0037] Figure 3 shows a graphical form the variability of the optimized 
parameter value firom place to place in a field undergoing harvesting. The Figure 
3 graph also includes, for comparison purposes, plots of parameter values 
30 calculated offline using a Least Squares technique also used to generate the plots 
of Figure 2; and 

[0038] Figure 4 is a comparison between a parameter value map and the slope 
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of the field to which it relates. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 



5 [0039] The terms "grain", "straw'*, and "tailings" are used principally 
throughout this specification for convenience and it should be understood that 
these terms are not intended to be limiting. Thus "grain" refers to that part of the 
crop which is threshed and separated firom the discardable part of the crop material 
which is referred to as "straw". Incompletely threshed ears are referred to as 

10 "tailings". Also, the terms "forward", "rearward", "upper", "lower", "left", 
"right", etc. when used in connection with the combine harvester and/or 
components thereof, are determined with reference to the combine harvester in its 
normal operational condition and may refer either to the direction of forward 
operative travel of the combine harvester or to the direction of normal material 

15 flow through components thereof. These terms should not be construed as 
limiting. 

[0040] Figure 1 shows the position of respective crop flow or loss sensors 10, 
11, 12 in the separation 13, cleaning 1) and return flow 15 sections of a typical 
20 combine harvester. The illustrated separation section comprises a set of straw 
walkers 13, but the invention may also be used with harvesters comprising a rotary 
separator. 

[0041] Any of the positions 10, 11, 12 may readily be used within the scope of 
25 the invention as locations for grain loss sensors. The following notes apply to the 
respective sensors: 

[0042] Sensor 10: 

Separation losses are generally measured by means of impact detectors. Impacts 
30 of kernels are separated firom impacts of straw ends and counted each second. By 
this, a measure is found for the amount of separation losses. Since the distribution 
of free grain kernels along the depth of the straw layer varies in time, only a rough 
indication is normally obtained. 
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[0043] Sensor 11: 

One similar impact sensor may be installed at the end of the cleaning section. 
Again only a rough measure is normally found for the sieve losses. 



5 [0044] Sensor 12: 

Tailings fall behind the lower sieve into the cross auger of the return flow system. 
An impeller is installed at the end of the fast rotating auger to spread the return 
flow. The sensor preferably operates measuring the phase shift between a fixed 
impeller and a flexible one as described in EP-A-0 463 240. Higher material 

10 flows imply larger phase shifts. 

[0045] In addition, the harvester preferably is equipped with precision farming 
tools to measure the actual cutting width, ground speed, mass flow, feedrate and 
position within the field. 



[0046] The outputs of such sensors may be employed in a technique, involving 
the use of an offline model for the crop processing operation. Establishing such 
model involves the determination of one or more parameters, e.g. a threshability 
parameter S . 



[0047] The exponential function offers good opportunities to make a 
prediction y{^,3) of actual separation losses y{t) (T/h) based on an online 
measurement of feedrate u(t) (T/h). The feedrate may be measured at the inlet of 
the harvester, e.g. by monitoring the volume of crop material entering the straw 
25 elevator, or by measuring the force or torque needed to convey the crop mass into 
the machine. 

[0048] Advantageously, the exponential function may take the form of: 



15 



20 



30 




(1) 



Equation (1) illustrates that no separation losses occurs for a zero feedrate and the 
feedrate-Ioss relation is fully determined by parameter »9. The time delay 
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between the feedrate signal u(t) and y(t) is assumed to be fixed and an optimal 
fixed time shift (typically lis) is installed as a compensation. For online 
measurements, separation losses and feedrate will be expressed in respectively 
impacts per second (#/s) and Volt (V). To optimize the parameter i9 , following 
5 quadratic criterion V{3) is proposed in function of prediction error s{t, S) (#/s): 

V{3) = E{0.5e'{t, &)} e{u ^) = y{t) - y{t. . (2) 

[0049] In case an optimal solution has to be found after N discrete input and 
10 output measurements (uk, are carried out, V{3) can be approximated by 

vM=^jl0.5e'{k,&). (3) 

15 [0050] For each set of N measurements it is possible to find an optimal 
parameter 3 wherefor the quadratic criterion V{S) is minimised. Figure 2 gives 
the optimized exponential relation for five sections in one 330m harvest strip with 
a large variance in threshabiUty due to different nitrogen applications and slope (a) 
fluctuations. In the first and last section, some erratic data points are lying near to 

20 the X and Y-axis respectively because of the dynamic step responses when the 
harvester enters and leaves the crop. 

[005 1 ] Recursive estimation of grain loss curves 

25 As can be seen in Figure 2, a large variance in the model parameter can be 
detected in one single crop strip. Therefore, it is preferable to have an online 
optimal estimation (in accordance with the invention) of the local separation 
behaviour. This site-specific information offers new possibilities for automatic 
tuning systems in a more direct way compared to the prior art online yield 

30 mapping systems, since it immediately relates feedrate u(t) with straw walker 
losses y(t) and provides an extra crop parameter S that may play an important role 
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in the evaluation of new crop varieties. 



[0052] Herein an online optimization procedure is derived based on a 
stochastic gradient method. The stochastic gradient method can be seen as a 
5 stochastic analog of the method of steepest descent for the minimisation of a 
deterministic function. In its general form, this method of steepest descent is 
represented by: 
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dx 



V(x) 



|.t=;t<') 



(4) 



where x^'^ denotes the t th iterate and /^'^ a chosen positive scalar. This approach 
may show useful , however, when the iterates are getting close to the minimum, 
this method is known to be fairly inefficient. 

15 [0053] The so-called quasi-Newton methods yield distinctly better results and 
use a modified search direction from the negative gradient direction: 



dx^ 



~V{x) 



dx 



V{x) 



(5) 



20 This iteration will provide convergence in one step to the minimum of if 
this function is quadratic in;c and y^'^ s 0.5 . 

[0054] When applied to the present optimization problem, the quasi-Newton 
optimization scheme can be transformed into following gradient scheme, which 
25 could be called a "stochastic Newton algorithm": 



v{s)=ehM)) 



(6) 



3{t) = 3{t - 1) -h riiv " (3{t - 1), e' )Y Q{3{t - 1), ) 

30 
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(7) 



where F" (.) denotes the approximate Hessian, -Q (.) is the gradient of H(x,e) with 
respect to x and e' indicates that the approximation depends on previous noise 
values = e(t), e(t'l)y ... When this scheme is applied to the problem definition 
of equation (1) and (2), following algorithm is obtained for the model parameter 
5 ^^(0: 

3{t) = 3{t - 1) + r{ty-' {t^, S{t - l))s(t, 9{t - 1)) (8) 

where 3) = '^^ and scalar r(t) corresponds with the instantaneous 

10 estimation of Hessian F"(i9). When an exponential process model according to 
function (1) has been chosen, if/{t,S) will be equal to exp(5.M(/)).w(/) . 



[0055] The accuracy of this approximation of the true Hessian plays a 
particularly important part when the recursive algorithm is operating close to the 
15 minimum. The natural approximation of this Hessian is to introduce the sample 
mean value: 



F(^)= E (^ S)h\t - 1))= r{t) (9) 

20 [0056] However, the estimation of r(t) in equation (9) puts as much attention 
on measurements temporally far from / as on more recent measurements. 
Therefore, a weighted estimation of r(t) usually yields better results: 

r{t) = Z Pit. ky (k, 3{k - 1))+ S{t)r, (10) 

25 

where ro denotes the initial estimation of the Hessian function and weighting 
coefficients /?(/, k) and S{t) should be chosen such that 



(11) 



*=i 
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[0057] 



A standard way to define the weighting coefficients is given by 



rithro s{t)^Yl[i-ro] fiM^Ui^-yol (i2) 

it=l J^k+l 

5 

It is easy to verify that this choice of parameters fulfils condition (11). Constant 
gain parameter corresponds to an exponential forgetting factor Zq =1-/^. 

[0058] A preferred but non-limiting practical realisation of this stochastic 
10 Newton algorithm is shown hereinafter: 

r {0)=ro; 
e(0)=eo; 
k=l; 

15 while (k<N); 

4f(k)=u(k)*exp[u(k)*e(k-l) ] ; 

e (k)=y(k)-exp[u(k) *e{k-l) ]+l; 

r(k)=r(k-l)+Yo*[^' (k)-r(k-l) ] ; 

e(k)=e(k-l)+Yo*i|/(k)*e(k) /r(k) ; 
20 k++; 
end; 

[0059] The algorithm is computationally cheap and can easily be implemented 
in machine software. Three parameters have to be determined before starting the 
25 algorithm. The preferred but non-limiting default values that are used in this study 
are added between brackets. 



1. Gain sequence y{k) is set at a constant value /q (0.2). This parameter 

immediately determines the tracking capabilities of the algorithm but has also 

30 an important influence on the variance on the estimation of parameter &{k) . A 

high constant gain brings about fast tracking dynamics to follow fluctuations of 

S{k), but introduces large fluctuations around the true S{k), even when the 
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true parameter does not vary in time. It depends on the application purposes 
and sample frequency whether a high or low gain should be chosen. 

2. The initial estimation ro (500) of the Hessian function determines the 
5 confidence of having an accurate initial estimation of 3{k) A high value of ro 

implies a long term effect of the initial estimation 3^ on the following 
parameter estimations. 

3. Different strategies can be introduced to choose the initial parameter estimation 
10 9q (8). The last parameter value of a previous harvest run can be used or a 

parameter estimation of a near by crop strip when the tracking algorithm is 
connected to a positioning system. 

[0060] Results and discussion 

15 

The algorithm that has been developed in the previous section can be used to track 
the relation between all combinations of process (e.g. separation) and feedrate 
sensors, Hereabove, the relation between feedrate and straw walker losses has 
been studied in more detail, since it may be used in automatic tuning systems that 

20 control the straw walker losses by adapting the feedrate. When the static non- 
linear characteristic between both signals can be tracked online, a ground speed 
control system can be realised that keeps the straw walker losses at a predefined 
level. When such knowledge about the instantaneous separation behaviour would 
not be available, more conservative controllers have to be designed, resulting in 

25 lower control performances. 

[0061] In Figure 2, the signals of one 330 m harvest strip were divided into 

five distinct sections of about 66 m each. For each section, an optimal exponential 

parameter 9 is calculated based on offline optimization techniques. Figure 3 

30 shows the results of the recursive algorithm for the same harvest strip. The results 

of the previously described offline optimization procedure are also shown to 

illustrate the performance of the tracking algorithm. Roughly the same parameters 

are obtained, but now in an online, recursive way. The zone between 50 and 1 50 
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m corresponds to data from an uphill section (+15%). Harvesting uphill reduces 
the separation capacity of conventional harvesters and as a result, larger 
coefficients 3 are obtained. Similar results are found for zones with smaller 
grain/straw ratios or higher moisture contents. 

5 

[0062] Site-Specific interpretation of estimated parameter sequence 

In case variations of parameter 3 depend on local field conditions, the same trend 
should be visible in adjacent strips. Figure 4 shows this type of parameter map for 

10 a set of 7 runs that are harvested uphill, parallel to the Y-axis. The correlation 
with the field slope or machine slope is evident, illustrating the value of this type 
of parametric maps for on-line tuning of harvesters, before variations in local 
processability are actually registered. This field was fertilised with different doses 
of Nitrogen in strips parallel to the Y-axis. Therefore, the harvester reacts in a 

15 slightly different way according to the Nitrogen gift and by this, to its position on 
the X-axis. A field with a constant Nitrogen application would give an even better 
correlation of the parameter and slope map. 

[0063] Although in the foregoing discussion the relationship between feedrate 
20 u(t) and straw walker losses y(t) is described, the method of the invention could 
equally well be used for optimizing parameters 3 in models for other crop 
handling processes at any of the following sections of a combine harvester: 
the separation section, e.g. the straw walker or the separator rotor; 
the sieves; 
25 the retum flow system; or 

the cleaning section; 
or indeed in sections of other kinds of harvester. 

[0064] A processability parameter can also be used for predicting the 
30 behaviour of the harvesting machine with respect to other effectiveness values 
such as the proportion of damaged useable crop parts, e.g. broken grain kemels, 
or a proportion of unwanted material in the useable crop parts, e.g. chaff and 
straw and particles in the clean grain. 
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[0065] The ability of the method of the invention to optimize the parameter 3 
in an online way offers numerous potential advantages, such as: 

the ability to devise a reliable vehicle control system that controls a 
5 performance variable of the harvesting machine and that relies on a feedrate set 
point calculated by an inverted form of Equation (1); 

the ability to devise processability-based expert systems, e.g. diagnostic 
systems that are self-executing in a combine harvester; warning systems 
manifested as feedrate or parameter "out of range" values; or information systems 
10 such as gradient-related data about likely crop losses. 

[0066] A further advantage of the methods of the invention is that the 
processability parameter 3 can if desired be assessed largely independently of the 
various sensing subsystems of a harvesting machine equipped for precision 
15 farming. In other words the optimized threshability parameter 9 implicitly takes 
account of the crop, vehicle and field conditions that give rise to a particular value 
of 9 , without necessarily having to evaluate each individual cause. 

[0067] The method described in full detail above can be used for optimizing a 
20 single parameter used in a model for crop processing. However, it is readily 
conceivable that analogous methods can be used for optimizing two or more 
stochastic parameters where such plurality of parameters is used for modelling an 
operation in a harvesting machine. Each parameter by itself, or each combination 
of parameters, can constitute a characteristic of the readiness with which the crop 
25 is processed. 
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